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Networked estimation under information 

constraints* 

Usman A. Khan^ and Ali Jadbabaie^ 

Abstract 

In this paper, we study estimation of potentially unstable linear dynamical systems when the 
observations are distributed over a network. We are interested in scenarios when the information 
exchange among the agents is restricted. In particular, we consider that each agent can exchange 
information with its neighbors only once per dynamical system evolution-step. Existing work with similar 
information-constraints is restricted to static parameter estimation, whereas, the work on dynamical 
systems assumes large number of information exchange iterations between every two consecutive system 
evolution steps. 

We show that when the agent communication network is sparely-connected, the sparsity of the 
network plays a key role in the stability and performance of the underlying estimation algorithm. To 
this end, we introduce the notion of Network Tracing Capacity (NTC), which is defined as the largest 
two-norm of the system matrix that can be estimated with bounded error Extending this to fully- 
connected networks or infinite information exchanges (per dynamical system evolution-step), we note 
that the NTC is infinite, i.e., any dynamical system can be estimated with bounded error. In short, the 
NTC characterizes the estimation capability of a sparse network by relating it to the evolution of the 
underlying dynamical system. 

I. Introduction 

Existing approaches to decentralized estimation or social learning are restricted to either (i) 
static (a fixed number) parameter estimation [HI, [[3]|, H, BH; or, (ii) when the parameter 
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of interest is dynamic, the estimation demands a large number of agent communications within 
each dynamical system evolution stepQflU, [fTOl. [fTTI . [fT2ll . In this paper, we consider networked 
estimation of (vector) dynamical systems in the context of single time-scale estimation, i.e., when 
each agent can communication only once with its neighbors per dynamical system evolution 
step 1131. Interested readers may also see [|T4ll . where identity system and observation matrices 
are considered. 

We consider social learning and networked estimation where the state of the world follows a 
potentially unstable discrete-time linear dynamical system. The dynamical system is monitored 
by a network of agents that have linear noisy observations and the agents are able to communicate 
over a sparse topology. Estimation within such settings heavily relies on the communication time- 
scale among the agents [13J. To motivate this, we refer to Fig. [T| where Fig. [T]^a) shows the 
traditional networked estimation approach, e.g., the Kalman-consensus filter [9|, where a large- 
number of consensus iterations are required between each k and k + 1; k being the time-index 
of the discrete-time dynamical system. On the other hand, our approach implements the agent 
communication and sensing at the same time-index, k, of the dynamical system; we show this 
inFig.fTJb). 

We assume that the agents are collectively-observable, i.e., the collection of all of the agent 
observations guarantees observability of the underlying state. It turns out that the collective- 
observability, although necessary, is not sufficient when we restrict to single time-scale estima- 
tion. This is due to the fact that the dynamics can be faster than the rate of observation fusion 
supported by a sparse network. The network connectivity and observation structure should be 
therefore related to the system instability. In this context, we address the networked estimation 
problem from two sides. Firstly, we formulate the estimation problem as a spectral radius (largest 
eigenvalue) optimization of concerned matrices. Borrowing results from Lyapunov theory and 
Linear Matrix Inequalities (LMIs), we show that in the networked setting, the LMI formulation 
reduces to a bi-(multi-)linear optimization and may not have a solution. In cases when the 
LMIs do have a solution, we provide an iterative optimization procedure based on a cone 
complementarity linearization algorithm [fT5l . 

'with the exception of |6l, IT), (8), in which the parameter is a scalar and each agent is assumed to observe this scalar state. 
Clearly, the scalar estimation problem has each agent observable, whereas we do not assume (i) local observability; or (ii) scalar 
states. 
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Fig. 1. Time-scales of dynamics, sensing and communication: (a) Large number of communication; (b) Communication and 
sensing at the time-scale of the dynamics. 

Secondly, we formulate the estimation problem as a (induced) two-norm (largest singular 
value) optimization of the underlying matrices. We note here that the two-norm approximation 
of the spectral radius can be conservative; however, this design process leads to insightful 
networked estimation arguments that are not formulated and/or explored before. In particular, we 
introduce the notion of Network Tracking Capacity (NTC), which quantifies the most unstable 
system that a network and a set of given observation models can track with bounded mean 
squared error (MSE|^ We further explore the two-norm procedure with scalar-gain estimators 
(see structured singular value and stability margins in robust control theory ifTSll ). and provide 
local design procedures using graph isomorphisms and eigenvalue bounds. 

In the context of single time-scale estimators, Reference [fT9l provides an algorithm for static 
parameter estimation, (see also ll20l where a distributed sub-gradient optimization is considered). 
On the other hand, the distributed estimation algorithm in ||6l considers scalar neutrally stable 
(unit system spectral radius) dynamical systems. Clearly, scalar dynamical systems are observable 
at each agent as each agent observing the scalar state is observable. This paper extends these 
works as we consider a multi-dimensional state-space that may not be locally observable at any 



^This notion can be related to the rate-constraints in information theory (the rate of sending information should be less that 
the channel capacity) and also to control under communication constraints (Mitter-Tatikonda 1161 , 1171 '). 
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Strict subset of agents. Recent work on distributed estimation also includes a series of papers 
by Olfati-Saber et. al. [|2l, where neighborhood (each agent plus its 

one-hop connected neighbors) observability is assumed. On the other hand, we do not assume 
observability of any agent or any strict subset of agents. 

The distributed estimation algorithm we propose is related to the parallel estimators in [i26i 
for closed-loop dynamics of cooperative vehicle formations. The overall framework in [[26ll is 
communication-oriented; the authors design the communication gain and receiver sensitivity for 
the parallel estimators. In addition, they also consider network topology design using a heuristic 
framework. There are also interesting parallels between this work and Reference [|27l. In the 
special case where observation models are chosen to be identical (which is not interesting in 
a distributed estimation context), our proposed estimator is the dual of the controller in [26]. 
Clearly, when all of the observation models are identical, each observation model has to be 
observable and designing the overall system reduces to the design of a single sub-system at any 
agent. 

The paper is organized is as follows: Preliminaries and notation are in Section |Ilj Section III 



states the problem and the single time-scale distributed estimation algorithm. We consider spectral 
radius estimator design in Section IV and the two-norm estimator design in Section |V} whereas. 



Section VI considers error performance of the estimator. Section VII considers scalar gain 



estimators, whereas Section VIII explores local design of the estimator parameters. Finally 



Section |IX] provides an illustration and Section |X] concludes the paper. 

II. Preliminaries 
This section provides preliminaries and sets notation. 

System model: Consider a time-varying parameter, G W^,n > 1, that corresponds to a 
phenomenon of interest. We assume the following discrete-time linear dynamical system for x^: 

Xfc+l = AXfc + Vfc, (1) 

where k is the discrete-time index, A E M"^" is a potentially unstable system matrix, and is 
the noise in the system evolution such that 

E[v,] =0, E [v,v^] = V. (2) 
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We assume that the phenomenon of interest ([T]) is monitored by a network of agents. The 
observation model at the ith agent is given by 

= i7,Xfc + 4, (3) 

where the agent measurements can be collected to form a global observation, i.e., 

yk = Hyik + rfc, (4) 







Hi 












X/c + 








Hn 







We assume 

EK.] =0, E [rlrf] = Elr.rJ] = R. (6) 

The noise sequences, {'Vk}k>o and {r^^j^fQ-^, are statistically independent over time. We assume 
the system to be observable with the global observations, i.e., the pair {A, H) is observable. Note 
that any strict subset of agents may not be necessarily observable. 

System instability: We characterize the stability of the state dynamics in terms of the induced 
2-norm of the system matrix. A, as opposed to the spectral radiu^ i.e., 

a ^ \\A\\2 = ^XniA^A), (7) 

where < Ai(-) < . . . < A„(-) are the eigenvalues of the symmetric positive (semi) definite 
matrix A. 

Network connectivity: The interactions among the agents are modeled with an undirected 
graph, G = {V,£), where V = {1, . . . , A^} is the set of vertices and £^ C V x V is a set of 
ordered pairs describing the interconnections among the agents. The neighborhood at the iih. 
agent is defined as 

The matrix L denotes the Laplacian matrix of G. For details on graph-theoretic concepts, see [|28l . 

^The induced two-norm (largest singular value) and spectral radius (largest eigenvalue) are identical for normal system matrices. 
For non-normal system matrices, the induced two-norm is an upper bound on the spectral radius and may be a conservative 
estimate of stability. However, the convexity of the two-norm makes it tractable for optimization. 
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III. Problem formulation: Single time-scale estimator 



In this section, we present our problem formulation. In particular, we present a single time-scale 
networked estimator that is implemented at each agent to estimate the time-varying state, x^, 
of the underlying phenomenon ([T]). Let x^^^ G M" denote the estimate of x^ at agent i and 
time k + 1, given by 



A 



\ 



(8) 



consensus update innovation update 

for Wij E ]R>o such that J^jeAf- = 1; ^ J' ^i^^ ^ K"^"- At each agent, the consensus update 
averages the state estimates over its neighbors. On the other hand, the innovation update at agent i 
collects the observations at agent i and its neighbors {j E Mi) and uses its estimate, x^, to form 
the innovation, where Bi is the local innovation gairQ Notice that in ([8]), both the consensus 
step and the innovation step are implemented at the same time-scale, see Fig. [T] 
The local error process, el_^_^ E W\ at agent i and time /c + 1 is defined as 



i A_ 



By concatenating the local error processes, we get the network error process, ej^+i E 



Lefl W ^ {w^j}, B ^ diag[5i, ...,Bn], and 



(9) 



D 



H 



It can be verified that the network error process, e^+i, is given by 



(10) 



efc+i = Peu 



(11) 



''static parameter estimation algorithims thiat are structurally similar to ([Sj hiave also been considered in 1291 . 1301 . In particular, 
1301 shows that the specific consensus and innovation structure naturally arises if the networked mean-squared cost is assumed 
to be the sum of local costs. 



^Note that since Wij G R>o and ^ . 



1,V J, Vl^ is a stochastic matrix. 
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where P = (/^ ® A){W ^ In - BDh), uj, ^ (j) 

cPk = {In®A)B 



Vfc, and 



The design and analysis of the single time-scale networked estimator ([8]) concerns with 



studying the stability and steady-state performance of the networked error process ( [TT] ). We 
take the following approach in this regard: 



(i) Estimator design using LMIs (Section IV): We study the design of the matrices W and B 
such that p(P) < 1 (stable estimation error) using an LMI-based approach. Although this 
approach requires minimal assumptions, it does not guarantee the existence of W and B 
with p(P) < 1. This is because the underlying structure on W (graph sparsity) and B 
(block-diagonal) restricts the solution of the corresponding Linear Matrix Inequality (LMI). 

(ii) Two-norm design (Section|v]): We use the fact that p(P) < ||-P||2 and design the matrices W 
and B such that ||P||2 < 1, i-C-, instead of using the spectral radius constraint for stability, 
we resort to a two-norm constraint. This relaxation leads to the Network tracking Capacity 
(NTC) -the most unstable dynamical system that can be estimated with bounded estimation 
error under the structural constraints on W and B- arguments. 



(iii) Performance (Section VI): We study the performance of the networked estimator in terms 
of upper bounds on the steady-state error covariance. 



(iv) Scalar gain estimators (Section VII): We study the scalar gain estimator by restricting W = 
In — OiL and B = aInN- Hence, instead of designing the entire matrices, W and B, we 
only consider a scalar parameter, a G M, leading to local design of a at each agent. 

(v) Local design (Section VIII[ ): We consider local design of the scalar-gain estimator param- 
eters, where each agent can locally choose the scalar design parameter, a; we achieve this 
by using graph isomorphisms and some eigenvalue bounds. 



A. Special cases 

Before we proceed with the rest of the paper, we illustrate the applicability of the proposed 
estimator in ([8]) to some special cases. 
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1) Scalar systems with no collaboration: For scalar dynamical systems in = 1) with no 
collaboration (i.e., without the consensus update, wa = 1 and Wij = 0,i ^ j), the error (at 
the ith agent) in the proposed estimator is given by 

e*fc+i = axk + Vk-a[xl + bi{k)hi{hiXk + rl- hixl.)) , 

^k+1 

= a (l - hi{k)h1) el + Vk- abi{k)hir\. 

With no collaboration (no interagent interaction), the above error dynamics lead to a bounded 
MSB by choosing hi{k) = h^"^ and the error dynamics become 

el+i = Vk-ahThl, (12) 

regardless of the value of a. In particular, assuming independent system and observation noise 

and Elvkvl] = cx^, E[r^r^^] = a.^, we have 

nelef] = al + ahfal. (13) 

This is because the scalar system is observable at each agent i as long as hi ^ 0. Hence, 
collaboration is not required to guarantee bounded MSB and the proposed estimator results in 
bounded MSB for anjj^ a. However, with the addition of inter-agent information exchange, the 
steady performance of the estimator can be improved as we show next. 

2) Scalar systems with collaboration: When the agents interact over a sparse communication 
network, it can be shown that the error at the ith agent is given by 

4+1 = « ( XI ^^^'4 ~ ^^'^^^ \+^k-abiY^ hjvi, (14) 

where we used J2jeAf- ~ ^- '-^^ interaction, the error at each any agent is coupled with 

the neighboring error dynamics (and subsequently to errors at all of the nodes in the network 
assuming a connected network.) From the previous discussion, the networked error process as 

efc+i = a{W - f3{k)lN) Gk + blockdiag [vk - al3{k)rl] , (15) 

*We note that non-trivial choices of the estimator gain, bi(k), different from h~^, exist that also minimize the steady-state 
error at the price of slower convergence. With the choice of h~^, we note that the convergence is achieved in one-step; 
choosing 6,; — h^^ is sufficient to show that a bounded MSB does not require collaboration among the agents in the case of 
scalar dynamical systems. 
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where we have chosen bi{k) = (3{k){^j^j^_ '•^^ inverse exists if hi ^ 0, Vi. Note that 

all of the possible choices of (3{k) such that p(a {W — (^{k;)!^)) < 1, result into bounded MSE 
of the networked estimator. The estimator design, thus, depends on the weights chosen in W 
(stochastic) and (5{k;). The error dynamics further highlight that there exist unstable dynamics 
(a > 1) such that our proposed estimator results into bounded MSE. The unstable dynamics 
result from the stability margin in a {W — (3{k)Ij\f). 

In a further special case of neutrally stable system, i.e., a = 1, Reference [|6l shows that /3{k) 
can be chosen such that (3(k) follow some persistence and diminishing conditions. In other 
words, /3{k) is less than the (some) weight chosen in W, but they sum to infinit)]^ The advantage 
of choosing a diminishing gain, (3(k) — )■ 0, is that the constant in the networked error expression 
reduces to Vk- Using this observation combined with an assumption of diminishing innovations, 
i.e., Vk —7- 0, [6J shows that — 0. However, an avid reader may note that the persistence 
assumptions on (3{k) can only be made when a < 1. In other words, for a non-trivial system 
(a > 1), we cannot choose j3{k) — )■ 0. 

3) Social networks-Static parameter estimation: Static parameter estimation {A = I,Vk = 0) 
and aggregation behavior has been studied extensively in social networking applications in both 
Bayesian [|37l . [|38l and non-Bayesian settings ||39l , [|40l . BUl, for more details see references 
therein. In particular, (4] considers a scalar parameter to be estimated using belief propagation 
adding a network (consensus) term to the DeGroot model [IJ. In an abstract setting. Refer- 
ence [19] discusses a single time-scale estimator for static vector parameters that is close to our 
formulation (when restricted to the static case) in ([8]). 

IV. Estimator design using LMIs 
In this section, we consider the estimator design using an LMI based approach. Recall that 



we would like to choose W and B such that (see (11)) 



p{W ® A - (Jjv ® A)BDh) < 1. (16) 



^Such choices are motivated by standard stocliastic approximation techniques in recursive algorithms 1311 , 1321 . 1331 . These 
algorithms have been explored for non-scalar static systems in the context of distributed localization and consensus, for details 
see (H, |35l, (H. 
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The spectral radius is a non-convex function (unless the matrix is normal that may not be true in 
our formulation). Due to this, a tractable optimization is not not possible to minimize p(-). How- 



ever, assuming a full gain matrix, B, one may implement an LMI-based design that satisfies ( (T6| ) 
(this design may not minimize the spectral radius) as long as the pair (W Dh) is observable; 
see ll4T1l . lfT8l for details. We note here that in our formulation the gain, B, has structural 
constraints (block-diagonal); the corresponding LMIs, in general, do not have a solution. Clearly, 
this is the main difficulty in distributed estimation and control as convex/semidefinite approaches 
are not directly applicable. To this end, we resort to an iterative procedure to solve LMIs under 
structural constraints. 

Before we proceed with our methodology, we note that this formulation assumes the observ- 
ability of {W ® A, Dh)- Note that even when we assume {A, /J) -observability, we still have to 
choose an appropriate W that ensures the observability of (W ® A, Dh) in order to use LMIs. 
To this end. References [|42l . [|43ll , [|44l . discuss agent connectivity protocols to ensure structured 
observability of {W®A, Dh) given the observability of {A, H). These protocols are independent 
of a particular fusion rule, i.e., a strict choice of elements in W is not enforced as long as the 
sparsity (zero/non-zero pattern) is fixecj^ In the following, we assume that (W A,Dh) is 
observable by designing an appropriate communication network among the agents as discussed 

in m, m, m. 



A. LMIs under structural constraints 

Our method uses a cone complementarity linearization algorithm provided in IfTSl (see Wireless 
Control Network (WCN) in [46J). We describe the procedure below. Define 

A^{W ®A-{In®A)BDh). (17) 

From Lyapunov theory [fTSll . it is well-known that p{A) < 1 when the following Linear Matrix 
Inequality (LMI) holds for some X )~ Q (V denotes positive-definiteness), 

X - A^XA^O, 

^In fact, it can be shown that if [W ® A, Dh) is observable for some choice of W , then it is observable for almost all W'i 
with the same sparsity. The set of Vy's where it is not observable has zero Lebesgue measure 1451 . 
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^0, 



or, equivalently, when 

X A^X, 
XA X 

with X :^ 0, by using the Schur complement. Since the above is non-linear in the design 
parameter (products of X,W and X,B), we perform a change of variable and note that p{A) < 1, 
if and only if there exists X, F >- such that 

X A^, 
A Y 

with X = Y^^. The above LMI ( [T8] ) is linear in the design parameters X, W, and B, but the 
corresponding constraint, X = Y^^, is non-convex. 

Here, we use the approach in IfTSlI to approximate X = Y~^ with a linear function. In 
particular, the matrices, X,Y y 0, satisfy X = Y^^, if and only if they are optimal points of 



^0, 



(18) 



the following optimization problem. 

min tr{XY) subject to 



^0, 



X I 
I Y 

with X,Y y 0. Furthermore, W has to follow the graph, G, sparsity, and B is block-diagonal. 
The above discussion can be summarized in the following lemma. 

Lemma 1: The networked estimator is stable when structured matrices, W and B, are the 
solution of the following optimization. 



y 0, 



min tr{XY), 
X A^ 
A Y 
B is block-diagonal, 

W is stochastic and W 

X,F y 0. 



(19) 



X J, 
I Y 



h 0, 



The objective function is again a minimization of a non-convex object. (Notice that since the 
second LMI is equivalent to X = Y~^ [|4T]| . the minimum trace is achieved at X = and the 
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optimal value is nN.) To this end, we replace the trace operator over the product of X and Y 
with a linear approximation ll47l . [fT5l . 

4>^^^{X,Y)=triYoX + XoS), (20) 

and an iterative algorithm can be used to minimize tr{XY), under the constraints on W and B. 
The iterative algorithm [ITSlI is as follows: 
(i) Find feasible points Xq,Yo,W, B. If no such points exist, Terminate. 



(ii) Find Xt+i, Ft+i by minimizing tr{YtX + XtY) under the constraints in ([19)) 

(iii) Terminate when p{A) < 1 or according to a desirable stopping criterion. 



B. Discussion 

In the following, we briefly review the LMI-based spectral radius design and discuss its 
limitations. 

(i) Let St+i = tr{YtXt-^-i) + XtJ^iY), then it is shown in [fT5l that St is a decreasing sequence 
that converges to 2nN; the convergence to 2nN is because as t f, X^+i — > Y^^ and X G 
j^nNxnN _ Howcvcr, there is no analytical characterization of the convergence rate. 

(ii) An alternative stopping criterion, instead of (iii), can be established in terms of reaching 
within 2nN + e of the trace objective. 

(iii) The iterative procedure given above, similar to the cone-complementarity linearization 
algorithm in [15], is a centralized algorithm and has to be implemented at a center. However, the 
center has to implement this process only once, off-line, and then it may broadcast the appropriate 
estimator gain to each agent. Afterwards, the center plays no role in the implementation of local 
estimators at each agent; each agent, subsequently, observes and performs in-network operations 
to implement the estimator. 

(iv) A single time-scale algorithm can also be implemented, where the above iterative pro- 
cedure is implemented at the same time- scale k as of the dynamical system in ([T]). With this 
approach, the estimator gain becomes a function of k (i.e., -ft'fe+i) and may be transmitted to 
each agent at each time-step k. This is helpful when the implementation is assumed in real-time. 

(v) The LMI based spectral radius design provided in this section guarantees a solution if 



feasible points point, Xq, Yq, W, B, exist that satisfy the constraints of the minimization in ( 19). 



If no such points can be obtained then the spectral radius design does not result in a solution. 
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Hence, when a center-based implementation is not feasible or a solution does not exist using the 
LMI-based methods, we resort to the two-norm design procedure described in the next section. 

V. Estimator design under a convex relaxation 

As we explained before, the LMI-based design is centralized and may not result in a stable 
error process. To address such cases, we use a convex relaxation, p(P) < \\P\\2, and provide a 
design that is based on ||P||2 < 1 to ensure a stable error process. To this end, we characterize 
the Network Tracking Capacity (NTC) that quantifies the most unstable dynamical system, which 
a network and a set of given observation models may track with bounded error. With the help 
of the previous discussion, we have the following definition. 

Definition 1: [Network tracking capacity, C] Given the network connectivity, i.e., the net- 
work communication graph, G, and the observation matrices, {/7j}i<j<7v, the network tracking 
capacity, C, is defined as the most unstable dynamical system (in the 2-norm sense) that can be 
estimated by ([8]) with bounded mean-squared error (MSE). 

In the following, we derive an expression for the NTC, C, and show that V a = P||2 < C, 
there are a set of choices for the W = {wij} and B = blockdiag{-Bj} such that the networked 



estimator in ([8]) results into bounded estimation error. In Section VIT we consider a special case 
{Wii = 1 — a,Wijj^i = a, Bi = ain ) and design the parameter a, which leads to local design 
of the networked estimator studied in Section IVIIII 



A. Network tracking capacity 

In the following, we derive a mathematical expression for the NTC and explore some of its 
properties. To this end, we note the following: 

||P||2 = \\{lN®A){W®Ir.-BDH)\\2, 
< \\lN®A\\2\\W®In-BDH)h, 

= a\\W ^ In- BDnh- 

Note that all such stochastic matrices W E M^^^ and gain matrices Bi G M"^", which 
guarantee \\W In — BDii\2 < V*^' ensure a stable error process, i.e., ||P||2 < 1- Clearly, 
feasible W, B may not exist for all dynamical systems (i.e., for arbitrarily large a). Hence, it is 
natural to ask what is the range of a for which we can guarantee — BDh\\2 < l/a with 
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appropriate choices of W and B. This exposition naturally lends itself to the Definition [T] of 
Network Tracking Capacity (NTC) we introduced earlier. The following theorem mathematically 
characterizes the NTC, C. 

Theorem 1: The network tracking capacity, C, is given b) 



(J — \ C21) 

TmTlw,B\\W ®In- BDh\W 

Proof: To prove the above theorem, we have to show that for any a < C, there exist a 
stochastic matrix W and gain matrices _Bj's such that we have a stable error process, i.e., ||-P||2 < 
1. We assume a < C and choose 

[W,B] = Sirgimn^, B,\\W' ® /„ - B'Dnh, 

subject to W' is stochastic, (22) 



then we have 



|P||2 < aWW^In-BDnh, 

^ 1 {mmw,B\\W ^In- BDnh) 
mmw,B\\W (g) In- BDh\\2 

< 1. 



The above theorem shows that for all a < C, there exist W, B as given in ([22]) that ensure a 
stable error proces^ i.e., ||-P||2 < 1- Some properties of the NTC are explored below. 
Lemma 2: The NTC lies in the interval [1, oo], i.e., 1 < C < oo. 

Proof: Choosing W = and B = 0„Ar provides the lower bound. To get the upper bound 
consider a communication graph and an observation model that give BDh = Wi^In- For exam- 
ple, an observation model where each neighborhood is one-step observable (i.e., (XljeM ^J^i)^^ 
exists V i) suffices by choosing W = I and Bi = (XljeAT, ^J^j)'^- ■ 

'Note the parallels between this definition and the structured singular value (cf. 1181 and the references therein). The NTC is 
essentially quantifying the margin of stability of the estimator dynamics. 

'"This capacity argument is similar to the information-theoretic capacity argument, where the rate of information has to be 
less than the channel capacity for reliable conmiunication. Achieving the capacity in either case requires careful design of the 
underlying parameters, i.e., W, B in our case, under the appropriate constraints. 
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The above lemma shows that the NTC for a system where each neighborhood is one-step 
observable results into an infinite tracking capacity, i.e., any dynamical system can be tracked 
with bounded error. Similar argument shows that the capacity for a one-step observable system 
with a fully-connected agent network is also infinite (as J2jev ^I^j always invertible). In 
the case where we have no observations, i.e., Dh = OnN, it can be verified that C = 1, i.e., only 
stable dynamical systems (a < 1) can be tracked with bounded error. 

VI. Performance 

In this section, we study the performance of the single time- scale estimator ([8]). For this 
purpose, our main concern is the noise process, (linear combination of the system and the 
observation noise), in the error process, e^, see ( [TT] ). Note that 

E[uk] =0, E [ukuj] =0, J, (23) 

since both and (p^ are zero-mean and statistically independent over time. Define S to be the 
noise covariance matrix of the error process, i.e., 

S ^ E [ukul] = $ + 1^1^ ® V, 



where 



with 



$ = E[0fc0r] = (In 8) A)B{A ® ln)R{A ® InY B'\In ® A) 



R 



HJ^RnHn 



(24) 
(25) 



A = Adj(G) + /^. 

Using standard stability arguments for linear systems [[T8ll , it can be shown that the error process 
in ( [TT] ) is stable, and asymptotically unbiased, i.e., limfc^oo IE[efc+i] = 0, when we have 



P=||P||2 < 1. 

Furthermore, it can be verified that 



(26) 



i=o 
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and, asymptotically, assuming ||P||2 < 1, we have 

oo 

The two-norm of the steady-state error covariance can now be bounded above as 



i=0 

< (27) 

1 — 

The above upper bound can be further expanded as 



'oo 2 < 



i-||(j;v®^)(w^®/„-5Z}H)lli 



^ N\\V\\2 + II (/iV A)B{A In)R{A InfB^jlM ® 

l-a2||W^(8)7„-SDj^||2 ' ^ ^ 

where we have employed the triangle inequality and the fact that 

lllivl?, ^ ^||2 = ||ljvl?;i|2||^||2 = A^ll^lh- 

Similarly, using sub-multiplicative property of the two-norm and 

M®/n||2 = MII2 < ||livl^||2 = A^, 

we can further simplify the upper bound on H-S'ooH as 

Inc. II < 11^112 + a^Ar||E||ip||, 

^||5oo||2 < i_a2\\w®I^-BDH\\r ^ ^ 

where we scale the networked steady-state error by 1/N to write the steady error at each agent. 
Clearly, when we choose W and B such that a < 1/||VF ® In — BDh\\, we have a||VF ® In — 
BDh\\ < 1 and the denominator is never 0. In other words, when a < C, the steady-state error 
is bounded. In addition, the farther we operate from the capacity, the lower the steady-state error 
bound. 

Notice that the upper bound on the steady state error is small when both ||-B||2 and ||iy 
In — BDh\\2 are small. Hence, we may implement the following convex optimization. 

min||S||2 + \\W ^In- BDffh, (30) 

W,B 

subject to ||Vl^ <S> In - BDh\\2 < -, 

a 

W is stochastic and ~ G, 
B is block-diagonal. 
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Clearly, when the above constraints are satisfied, a stable estimator exists under the structure 
on the weight matrix, W, and the gain matrix, B. Minimizing the objective under stability and 
structural constraints further ensures a performance limit on the steady state error. 

VII. Scalar gain estimators 

Consider a special case of the estimator in ([8]) by choosing W = In — cuL and Bi = ain, V i, 
for some a E ]R>o. The resulting estimator at agent i and time k is given by 

= Ax^ -aAj2 {^k - xi - Hj {yi - H,%)) . (31) 

We term this estimator as the scalar gain estimator. We denote the NTC for this estimator by Ca- 
Clearly, we have 

< C. (32) 



It can be verified that the matrix P in ([TTj) for scalar gain estimators is given by 

P A (/^® A)(/„Ar-aQ), (33) 

where 

Q = L®In + Dh. (34) 

The rest of this section is dedicated to the study of scalar gain estimators. To establish our 
results, we provide the following lemma. 
Lemma 3: We have 

An7v(Q)-Ai(g) 



min \\InN - aQ\\2 



A„7v(Q) + Ai(g)' 



2 

aopt = argmin^||/„7v - aQlh = t — , . ■ (35) 

Proof: Since Q is symmetric positive semi-definite, its eigenvalues are positive reals. Since ||/nAr- 
aQ\\2 is also symmetric, we have 

\\I - aQ\\2 = max \Xi{I - aQ)\. 

l<i<nN 

The eigenvalues of / — aQ are 1 — aXi{Q). Hence, 

||/ - aQy = max{l - aXi{Q), aXnN{Q) - !}• 
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As a function of a, both 1 — a\i{Q) and aXnNiQ) — 1 are straight lines with slopes —\i{Q) 
and \nN{Q), respectively. Hence, the lines l — a\i{Q) and a\nN{Q) — 1 intersect at aint (having 
slopes opposite in sign). The point of intersection is given by 

l-«mtAl((5) = aintA„Ar((5) - 1, 

_ 2 

^ \nN{Q) + \l{Qy ^^^^ 

It can be verified that the considered minimization lies at aint, i.e., Oopt = aint, and is thus 
min ||/ — a(5||2 = minmaxjl — aAi(Q), aA„jv((5) — 1}, 

a a 

= l-aoptAi(Q), (37) 

and the lemma follows. ■ 
From the above lemma, we note that an equivalent expression for the NTC, Ca, is 

^ ^ XnNiQ)+XliQ) 

" A.^(Q)-Ai(Q)- ^-"'^ 
The following lemma establishes the NTC for connected (agent network) systems with one- 
step collective observabilit>{^ i.e., the following matrix 

iev 

is invertible. 

Lemma 4: Let G be connected, i.e., 

= Ai(L)<A2(L)<...<A;v(^), 

and let the observation models be collectively-observable in one time-step. Then Ca > 1. 

Proof: To prove the above lemma, we first show that, for a connected-observable system, 
the matrix Q is strictly positive-definite. We note that, since the graph is connected, the only 
eigenvector of the graph Laplacian corresponding to the eigenvalue is 1^ [28]. Hence, the 



"Notice that for scalar-gain estimators, since we have a single parameter, a, to design both network weights (W) and estimator 
gain (B), we require stronger (one-step) observability. Recall that the standard {A, /f) -observability is n-step. However, as we 
motivated before, no strict subset agents is assumed to be one-step observable. 
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eigenvector of L corresponding to the eigenvalue is l^v ® a, for any a G M". For this 
eigenvector 

N 

(l^®a)^Dj^(l^®a) = J] a^ J] i/Ji/.a, 

i=l j&Mi 

> a^Ga > 0, 

since G is invertible and strictly positive definite. Clearly, for any vector, b ^ 1^0a, for a G M", 
we have both b'^(L (g) /„)b > and h'^Dnh > 0. Hence, 

b'^gb' > 0, V b' G W^. 

Thus, the eigenvalues of Q (for connected-observable systems) are strictly positive, i.e., < 

\i{Q), and 

Ai(Q) - Ai(g) Ai(g) 

and the lemma follows. ■ 
The above lemma provides a fundamental result that for any connected and (one-step) observable 



system, there exist unstable (a > 1) dynamics that can be tracked by the estimator in pT| ) with 
bounded MSeE3 

A. Range of a 

In the following lemma, we show a range of a that ensures a stable error process, i.e., ||P||2 < 
1, V a < Ca- 
Lemma 5: Let a < Ca, then ||P||2 < 1 for 

/ a — 1 a + 1 \ ^ 

Proof: Assume a < Ca, then from ([38]) we have 



1 1 1 

< ^ 77^ + 



Ai(g) aAi(g) XnNiQ) aKwiQ)' 

'^Note that, due to ( |32) , the above lemma applies to the general class of estimators in ([Sj, i.e, C > 1 for connected (agent 
network) systems that are collectively observable in one-time step. 
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Hence, we can always choose an a in the interval defined in ( [40] ), i.e., because of the strict 
inequality in the above equation, we can always choose an a such that 

^ ^ <a< - — \—r + ^ . (41) 



\i{Q) aXi{Q) XnNiQ) aXnNiQ) 

The right inequality implies 



whereas the left inequality implies 



aXnNiQ) - 1< -, (42) 
a 



l-aXiiQ)<^. (43) 
a 



Combining ( [42| ) and ( [43] ), we note that there exists an a in the interval defined in ( [40| ) such that 

max{l - aXi{Q),aXnN{Q) -!}<-• 

a 



Hence, we have 



|/ - aQy = max{l - aXi{Q), aXnN{Q) - 1} < -, 

a 



and the lemma follows. Furthermore, it can also be shown that V « > ai, ||/ — aQ\\2 = 
aXnN — ^ > l/ct- Similarly, Va < ai, then ||/ — a(5||2 = 1 — aAi > 1/a. Hence, any a ^ (ao,cn) 
does not guarantee ||P||2 < 1. ■ 
The above lemma provides an interval such that any choice of a G (ao, «i) guarantees a stable 
estimator, i.e., ||P||2 < 1, as long as a < C^. We now show that that when a < Ca, then 
the ctopt G (ao; cti), as given in ( |35] ). 

Lemma 6: Let a < Ca, then «o < ctopt < cti- 
Proof: Since a < Cq,, we have 



which implies that 



7^ < (44) 

Ca a 



^" + ^ < (45) 



Ca ^ 

Ca — ^ a — 1 



Ca 



> • (46) 
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Now note that 



Cry 



'^XnNiQ) 



XnN{Q) + Xi{Qy 

2Ai(Q) 
XnNiQ) + XiiQ)- 



Combining (45) with (47), and (46) with (48), we get 



1 



< 



< 



a + 1 



aXi{Q) XnNiQ) + Xi{Q) aXnNiQ) 
and the lemma follows. 

Further note that the length of the interval (a;o,ai) is given by 



(47) 
(48) 

(49) 



1 



tti — ao 



aXnNiQ) aXi{Q)' 
XiiQ) + XnNiQ) - ajXnNiQ) ' X^jQ)) 
aXi{Q)XnN{Q) 



(A„iv(Q)-Ai(Q)) 



Ai(Q)+A„jv(Q) _ 
Aniv(Q)-Ai(Q) 

aXi{Q)XnNiQ) ' 



,Ai(Q) XnNiQ) J V ' ' ^^^^ 

confirming a non-empty interval for a when a < Ca or Ca/ a > I. The interval length is larger 
when Ca ^ a, providing more choices for choosing an a that give a stable estimator. On the 
other hand, the interval length is smaller when a ^ Ca- 

Note that the a interval, (ao,ai), depends on a = ||v4||2 and the eigenvalues of Q, which, in 
turn, depends on the graph Laplacian, L, and all of the observation models. Hence, computing 
this interval to select a suitable a requires global knowledge that may not be available at each 



agent. In Section VIII we provide an interval for a that is a subset of ( |40| ) but can be computed 
from quantities that may be locally available. 

B. Performance of the scalar gain estimator 
In case of scalar gain estimators, we have 
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Clearly, a convex optimization similar to ( [SO] ) may be formulated to design a that results into a 
stable estimator with a performance guarantee. 
Remarks: 



(i) We now show the performance bound with the optimal value of a from ( [35] ). With a = Oopt, 
we have ||J„7v — aQlh = The above upper bound can be simplified as 



4 

(A„]v(Q)+Ai(Q)) 



^-1 



Clearly, when a < Ca, the steady-state error remains bounded. 



(ii) Consider the performance of neutrally- stable scalar systems (see Section III-A2), i.e., we 
have a = l,n = 1, where Q = L + Dh- The steady- state performance at each agent is 

1 no n / al + a^N\\Rh 



iV" - l-\\h-a{L + DH)\\V 



where ||V^||2 — o"^^ similar to the noise variance in the scalar dynamics, Xk- It is straight- 
forward to note that there exists a such that < \\In — otQWi < 1 (following Lemma [4]) 
and the denominator is > 0. Following [6j, if we choose a such that a{k) — > (but sum to 
infinity) and we have diminishing innovation, i.e., cr^ — )■ 0, the steady-state error is bounded 
above by (perfect learning), 
(iii) Assume that the observation models at each agent is identical, i.e., 2/j,fc = Xk + rt^k and 
let ||rfc||2 < al, V k, then 

lllQ II < + (^^Nal 

iv" - l-||/„-«(L + /;v)ir 

When we do not have diminishing innovation, i.e., al is fixed for all k, then we can 
easily see that choosing an a relates to the trade-off between the convergence and steady- 
state performance of the single time-scale estimator. Typically, a oc -j^ to remove the 
dependence of the steady-state error bound on the number of agents, A^. 
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VIII. Local design of a 

The discussion on NTC and scalar gain estimators requires centralized computation of the 
estimator parameters (W, B, or a for scalar gain estimators). In this section, we present method- 
ologies to obtain the scalar parameter, a, locally at each agent. For this purpose, we use Lemma [5] 
that provides a range of a G (ao, cn) to implement stable estimators and consider strategies to 
compute this interval locally. 

We first provide some eigenvalue bounds to facilitate the development in this section. We 
then consider m-circulant graphs and special observation models to provide a local choice of a. 
Finally, we provide generalizations to the m-circulant graphs and arbitrary observation models. 

A. Eigenvalue bounds 

To derive an interval of a that may be locally computed, we use the following results from the 
matrix perturbation theory [[48|. Let Ai and Bi be symmetric positive semi-definite matrices with 
eigenvalues < \i{Ai) < ... < Ainax(^i). and < \i{Bi) < ... < Amax(-Bi), respectively. 
Then 

Ai(Ai) < Ai(Ai + 5i), (52a) 

Amax(^l+5i) < A,nax(^l) + Ai„ax(Si). (52b) 

In addition, we will use the following lemma from [49l. 

Lemma 7 (Theorem 2.1 in f49\l): Let z be an arbitrary column vector and let Ai be a sym- 
metric positive definite matrix with eigenvalues, < Xi{Ai) < . . . Amax(^i)5 then 

Ai(v4i + zz^) > Ai(Ai) + ^ (^gapi + ||zf - v/(gapi + ||z||2)2 - 4gapj2;i|2) , 

where 

gapi = A2(Ai)-Ai(A) >0, 
Zi = ql{A)z, 

the column vector qi(A) is the eigenvector of Ai corresponding to the minimum eigenvalue Ai(y4i) 
and denotes the Hermitian. 
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Now consider Ai in the above lemma to be an x graph Laplacian matrix, L. Then the 
eigenvector qi(Iv) corresponding to the minimum eigenvalue Ai(L) = is 



qi(^) 



1 



-I T 



Lemma [t] translates into the following lower bound on the minimum eigenvalue of L + zz^. 

Ai(L + zz^) > ^ (A2(L) + ||zf - ViHL) + - 4A2(L)kiP) , 

= r(A2(L),z). 

Clearly, the above lower bound is only non-trivial (r(A2(i^),z) > 0) when \2{L) > 0, i.e., for 
connected graphs and is for disconnected graphs (A2(i^) = 0). In particular, if we choose z = 
zi = [1, 0, . . . , 0], then 

r{X2{L), zi) = I (x,{L) + 1 - ^J{X,{L) + iy- 



B. Graphs isomorphic to m-circulant graphs 

In this section, we consider a particular example and derive the eigenvalue bounds in that 
case using the results from the previous subsection. We choose an m-circulant communication 
graph[^ with nodes and an n-dimensional dynamical system such that n = N. We choose the 
following observation model at the zth agent: 

yl=xl + rl (53) 

i.e., the observation matrix at the ith agent. Hi, is an A^-dimensional row vector with 1 at the ith 



location and zeros everywhere else. We partition the matrix Dh (see ( [T0| )) as Dh + Hh^ where 



Dh = h\ockdmg[Hl Hi, . . . , H^H^ 



and Drr = Dh — Dh- From (52), we have 



Ai(L ® /„ + Dh + Dh) > Ai(L ® /„ + Dh) 



(54) 



(55) 



We have the following lemma. 



"An m-circulant graph is a graph where the A'^ nodes are arranged as distinct points on a circle and each node is connected 
to m-forward neighbors. 
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Lemma 8: For m-circulant graphs and observation models of the form ( [53] ), we have 

S{L ® /„ + Dh) = Siln ® (L + HfHi)), 

for any i, where S denotes the spectrum (eigenvalues) of a matrix. 

Proof: We define an x (stride) permutation matrix, T, such that T{L®In)T^ = J„(g)L. 
With this permutation matrix, it can be verified that 

since Dh is diagonal and consists of I's only at those diagonal locations that are left unchanged 
with the permutation, T. The matrix In®L + DH consists of N nxn blocks where the jth block 
is given by L + Hj Hj. The matrix HjHj is an ri x ri matrix with a 1 at the (j, j) location and 
zeros everywhere else. Hence, L + HjHj is a Laplacian matrix whose (j, j) diagonal element 
is perturbed by 1. Since L corresponds to the Laplacian matrix of an m-circulant graph, the 
spectrum is left unchanged regardless of which diagonal element is perturbed, i.e.. 

Noting that the spectrum of a matrix does not change under a similarity transformation with a 
permutation matrix, we have for any i 

S{L + Dh) = S{T{L ® /„ + Dh)T) = ®L + Dh)= ® (L + H^Hi)). 



With the above lemma, ( pS] ) is further bounded below by 

= \,{L + HfH,), 

> t{UL),HJ), (56) 
from (|7]). Furthermore, for the observation models given by ( [53] ), the matrix Dh is diagonal 



whose element is either or 1. Hence, from (52), 



XnN{L(^ In + Dh) < XnN{L® In) + XnN{DH), 

= XnN{L®In) + l- (57) 
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The discussion in this subsection holds true for any graph that is isomorphic to an m-circulant 
graph. This is because a vertex relabeling of such a graph results into an m-circulant graph. 
Hence, for any graph that is isomorphic to an m-circulant graph, ([56]) serves as a lower bound 
of \i{L® !„ + Dh) and ( [57] ) serves as an upper bound for \nN{L® + Dh)- Thus, we have for 



any graph that is isomorphic to an m-circulant graph and observation models of the form ([53]), 
r(A2(L), zi) < Ai(g) < Kn{Q) < 1 + A„;v(^). (58) 
The following lemma now provides the main result of this section. 



Lemma 9: Consider a system with observation models in (53) and a communication graph 



that is isomorphic to m-circulant graphs. Let a < Ca, then ||P||2 < 1 for 

f o- — 1 a + 1 \ 

[aT{X2{L),z,ya{l + XML)))' ^ ^ 



Proof: Because of (58 ), the interval defined in ([59]) is a subset of the interval defined in (40) 



and the lemma follows form Lemma [5] ■ 
C. Generalization 

In this section, we generalize the development in the previous subsection to arbitrary graphs 
that contain at least one simple cycle of length as a subgraph. We denote such a graph 



as GoTv = (V,£^oiv) and denote its Laplacian matrix as L,^n. Let G^n = {V,Son) denote a 



simple cycle of length N and let Lqn' denote its Laplacian matrix. Then, L^^r = Lq^ + Li, 



where Li corresponds to the Laplacian matrix of (V, £(^n\£on)- We assume that the observation 



models are such that the matrix Dh can be decomposed into Dh (see (VIH-B )) plus some 



other Dhi, where Dhi is a positive semi-definite matrix. From (52), we have 



Ai(L ON ® In 



Hence, for all graphs G.jat and observation models that can be decomposed as Dh + Dhi 
with Dhi being positive semi definite, any 

G ( ~ ^ a + 1 \ ^^^^ 

Var(A2(L),zi)' a{XnN{DH) + XnN{L)) J 
results into stable error processes. Clearly, the above interval is only non-empty when a < Cioc, 
where 

^ Anjv(^g) + XnNjL) + r(A2(L), Zi) ^^^^ 

A„Ar(Dj/) + A„,Ar(L) - r(A2(L), zi) ■ 
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Fig. 2. Circulant graphs with m = 1, 2, 3. 



It can be shown that Cioc < C^- The gap between the two capacities (local,Cioc and scalar 
optimal, Co) depends on the tightness of the eigenvalue bounds used and on the interval length 
(proportional to Cq/1 — 1 ). 

For most classes of structured graphs, the minimum and maximum eigenvalues are known in 
closed-form as a function of N and hence, can be used at each agent to compute the interval 



for a in (40). In the case of non- structured graphs, one may use properties of a given graph 



to bound the minimum and maximum eigenvalues of its Laplacian and use the interval in ( [60| ). 
Similarly, for structured observation models, A„jv(-Dh) may be computed or upper-bounded (in 
the worst case) at the agents to locally compute the interval for a. Clearly, when we use a tighter 
interval for a using a local procedure, we pay a price in terms of a loss in capacity. 



IX. Illustration 

In this section, we provide an illustration of the concepts introduced in this paper. Consider 
an A^-node m-circulant graph, G^m, i.e., the nodes are arranged as distinct points on a circle and 
each node is connected to its next m neighbors. For such a graph, the Laplacian matrix, L^m, is a 
circulant matrix that can be diagonalized by an x normalized DFT matrix. We consider M = 
1, 2, 3, as shown in Fig. |2} We further consider an n = dimensional state-space and scalar 
observation models such that the ith node observes a noisy version of x], at time k, as given 
in ( [53] ). The capacity, C, of the graphs in Fig.[2]is shown in Fig.[3]^left). The capacity is calculated 
by using a convex program to solve pT] ). Note that m = 1, N = 2,3, m = 2, N = 2, . . . ,5, 
and m = 3, N = 2, . . . ,7 are fully-connected graphs. For fully-connected graphs, the capacity 
is infinite if we use the estimator in ([8]) as discussed after Lemma |2j 

We now consider scalar gain estimators. The capacity, Ca, of the m-circulant graphs with 
scalar observation models is plotted in Fig. [3]^right) for m = 1, . . . , 3 as a function of A^. If we 
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Fig. 3. (Left) NTC, C for m-circulant graphs with scalar observation models. Notice for fully connected graphs the capacity 
is infinite. (Right) NTC, Ca, for scalar gain estimator and m-circulant graphs with scalar observation models. 



restrict ourselves to scalar gain estimators then full capacity is not achievable with the scalar 
observation models even with the fully-connected graphs. It can also be noted that the NTC is 
always greater than unity. 

Figs. [3] explicitly characterize the relation of estimable systems to the underlying (agent) 
network connectivity. As we increase m in a circulant graph (with fixed number of nodes, A^), 
the information flow (or the algebraic connectivity) increases resulting into a richer set of 
estimable systems. The results explicitly show that the system (in)stability plays a vital roles in 
the estimation capacity of a network. For a weakly-connected network, we pay a price by being 
restricted to only those dynamical systems that evolve slower. 

A. Each agent observable 

Consider each agent i to be such that HfHi is invertible V In this case, choose 

W = 0„^, (62) 
B = blockdiag[( HjH^)-\ . . . , ( 5^ HjH,)-\ (63) 

With the above W and B, we have 

W-BDh = QnN. (64) 
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and C — oo, i.e., any dynamical system (a < oo) can be tracked with bounded error. In other 
words, when each agent is observable then any arbitrary dynamical system can be tracked with 
bounded error regardless of the network. 

B. No observations 

Consider the system to have no observations, i.e., Dh — 0. In this case, no matter we choose 
for W and B, we will have NTC, C — 1 and only stable dynamical system {a <Ca — 1) can be 
tracked with bounded MSB. This example shows that if there are no observations, only stable 
dynamical system can be tracked with bounded error. This is intuitive as any consistent estimate 
of a stable system results into bounded MSB. 

X. Conclusions 

In this paper, we explore two networked estimator design paradigms based on LMI methods 
and two-norm relaxations. The premise of our approach is single time-scale algorithms where 
only one informatione xchange is allowed between each successive system evolution step. We 
particularly consider vector state-space where the observability is assumed on the collection of 
all of the agent measurements, i.e., any strict subset of agents may not be necessarily observable. 
Our formulation considers arbitrary dynamics and is not restricted to stable or neutrally-stable 
systems. 

We first consider the spectral design using a cone cone complementarity linearization algorithm 
that requires minimal assumptions but may not result in a solution. We then resort to a two- 
norm relaxation of the spectral radius and provide the Network Tracking Capacity. We show that 
the proposed networked estimator results into a bounded MSB for all linear dynamical systems 
whose instability (in the 2-norm sense) is strictly less than the NTC. Bor both procedure, we 
explicitly provide non-trivial upper bounds on the steady-state covariance and further explore 
convex procedures that address performance in addition to stability. We then consider a simple 
networked estimator where the design is restricted to a single parameter that we term as scalar- 
gain estimators. With the help of scalar-gain estimators, we provide completely local design 
principles to implement local estimators with bounded MSB. 
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